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Abstract 



o 

What is the value of information in solving linear programming? The celebrated ellipsoid 
$H \ algorithm tells us that the full information of input constraints is not necessary; the algorithm 

works as long as there exists an oracle that, on a proposed candidate solution, returns a violation 
in the format of a separating hyperplane. Can linear programming still be efficiently solved if 
the returned violation is in another format? 

We study this question in a trial-and-error setting: there is an oracle that, upon a proposed 
solution, returns the index of an arbitrary violated constraint (with the content of the constraint 
still hidden). We give an algorithm with running time O(m polv ^ n ' ■ L), where m and n are the 
numbers of constraints and variables, respectively, and L is the input size of the linear program. 
c/3 The exponential dependence on n is unfortunately unavoidable; we show a lower bound of 

£l(mL n / 2 J) on the number of queries needed. Meanwhile, if the oracle provides more violation 
information — the index of a "most violated" constraint, measured by the Euclidean distance of 
the proposed solution and the half-spaces defined by the constraints — then we show that the 

J^ linear program can be solved in polynomial time. 

_i- • The proofs of the results employ a variety of geometric techniques, including McMullen's 

(S) ' Upper Bound Theorem, the weighted spherical Voronoi diagram, and the furthest Voronoi dia- 

gram. In addition, we give an alternative proof to a conjecture of Laszlo Fejes Toth on bounding 

T-j- ' the number of disconnected components formed by the union of m convex bodies in W 1 . Our 

proof, inspired by the Gauss-Bonnet Theorem in global differential geometry, is independent of 

C*~) ' the known and clearly reveals more insights into the problem and bound. 
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1 Introduction 

Solving linear programming (LP) is a central question studied in operations research and theoretical 
computer science. The existence of efficient algorithms for LP is one of the cornerstones of a broad 
class of designs in, for instance, approximation algorithms and combinatorial optimization. The 
feasibility problem of linear programming asks to find an x G M. n to satisfy a number of linear 
constraints Ax > b. Some previous algorithms, such as the simplex and interior point algorithms, 
assume that the constraints are explicitly given. In contrast, the ellipsoid method is able to find a 
feasible solution even without full knowledge of the constraints. This remarkable property grants 
the ellipsoid method an important role in many theoretical applications. 

A central ingredient in the ellipsoid method is an oracle that, for a proposed (infeasible) point 
x £ M. n , provides a violation that separates x and the feasible region of the LP in the format 
of a hyperplane. Such a separation oracle captures situations in which the input constraints are 
unavailable or cannot be accessed affordably, and the available information is from separating 
hyperplanes for proposed solutions. A natural question is what if the feedback for a proposed 
solution is not a separating hyperplane. Aside from theoretical curiosity, the question relates to 
practical applications, where the acquired violation information is actually rather different and even 
more restricted and limited. 

• Transmit power control in cellular networks has been extensively studied in the past two decades, 
and the techniques developed have become foundations in the CDMA standards in today's 3G 
networks. In a typical scenario, there are a number of pairs of transmitters and receivers, and 
the transmission power of each transmitter needs to be determined to ensure that the signal is 
strong enough for the target receiver, yet not so strong that it interferes with other receivers. This 
requirement can be written as an LP of the form Ax > b, where each constraint i corresponds 
to the requirement that the Signal to Interference Ratio is no less than a certain threshold. 
In general the power control is a well-known hard problem (except for very few cases, such as 
power minimization [H]); a major difficulty is that matrix A depends mainly on the "channel 
gains" , which are largely unknown in many practical scenarios [4 J . Theoretically, we face a linear 
programming problem Ax > b with the input A and b unknown. In practice, the system can 
adjust candidate solutions through observed violation information (for example, transmitters can 
test whether the desirable signal can be clearly detected at a specific transmission power). 

• Security games study how to arrange schedules of limited security resources to protect certain tar- 
gets from attack, and have been employed successfully to develop schedules for security agencies 
at Los Angeles Airport, and in the U.S. Federal Air Marshal Service and the U.S. Transportation 
Security Administration [29]. In a security game, a defender first plans security schedules to 
monitor a number of target sites, each of which is protected if the schedules satisfy a certain 
linear constraint. The coefficients of the constraints, however, depend on the attacker's expertise 
and strength, which are usually unknown to the defender. During an attack, the defender ob- 
serves which targets are attacked but may still not understand how the constraints are violated. 
In other words, the defender learns very little about the hidden coefficients. (Indeed, most such 
information is learned through years of practical experience.) 

In the above examples, for any unsatisfied proposed solution, only certain salient phenomena 
of violation are exhibited, including signal interference and attacked targets. These phenomena 
usually give indices of violated constraints but not their contents, of which we usually have a very 
limited understanding. With so little information obtained from violations, is it still possible to 



solve linear programming efficiently? We attempt to answer that question in the present paper. 
Our work addresses the value of information in solving LP, and can hopefully help to deepen our 
understanding of the following general question. 

What is the least amount of information, in what format, that one needs to solve a 
linear program efficiently? 

In this paper, we address the above question by testing both sides of the boundary. 

1.1 Our Model and Results 

Motivated by the aforementioned examples, we study solving linear programming in the following 
model. In an LP Ax > b, the constraints aix > bi are hidden to us. We can propose candidate 
solutions x G W 1 to a verification oracleu. If x satisfies Ax > b, then the oracle returns Yes and 
the job is done. If x is not a feasible solution, then the oracle returns the index of a violated 
constraint. The algorithm continues until it either finds a feasible solution or concludes that no 
feasible solution exists. The algorithm is adaptive in the sense that future queries may depend 
on the information returned during previous queries. We focus only on the feasibility problem, to 
which an optimization LP can be transformed by a standard binary search. 

Note that when the proposed solution is not feasible, the oracle returns only the index i of 
a violation rather than the constraint a^x > bi itself. We make this assumption for two reasons. 
First, consistent with the aforementioned examples, we are often only able to observe unsatisfactory 
phenomena, such as strong interference in the power control problem and adversaries' attacks in 
security games. However, the exact reasons (corresponding to the content of violated constraints) 
for these problems may still be unknown. Second, as our major focus is on the value of information 
in solving linear programming, a weaker assumption on the information obtained implies stronger 
algorithmic complexity results. Indeed, as will be shown, in some settings efficient algorithms exist 
even with this seeming deficit of information. 

For a proposed solution x, if there are multiple violated constraints, the oracle returns the 
index of one of them. This raises the question of which violation the oracle returns. Here we study 
two variants. The first variant follows the tradition of worst-case analysis in theoretical computer 
science, and makes no assumption about the returned violation. The oracle is referred to as the 
worst-case oracle. 

In the second variant, the oracle gives more information by returning the index of a "most 
violated" constraint, where the extent of a violation is measured by the Euclidean distance of the 
proposed solution x and the half-space defined by the constraint. This oracle, referred to as the 
furthest oracle, attempts to capture the situation in which the first violation that occurs or is 
observed is usually the most severe. For instance, in security games attackers, after conducting 
surveillance over an extended period, devise best ways to attack, which usually focus on defenders' 
weakest points. 

We will denote by UnknownLP the problem of solving LP with unknown constraints in the above 
model. In either oracle model, the time complexity is the minimum amount of time needed for any 
algorithm to solve the UnknownLP problem, where each query, as in the standard query complexity, 
costs a unit of time. We summarize our results as follows. 



lr The verification oracle is simply a means of determining whether a solution is feasible. It arises from the nature 
of LP as shown from the foregoing examples. For infeasible solutions, the feedback is a signaled violation. 



Worst-case oracle. For the worst-case oracle, we first establish the following upper bound result. 

Theorem 1. The UnknownLP problem with m constraints, n variables, and input size L can be 
deterministically solved in time 0{m p y ^ n > ■ L). In particular, the algorithm is of polynomial time 
for constant dimensional LP (i.e. constant number of variables). 

At the heart of our algorithm's efficiency control is a technical bound of Yli=o (T) on ^ ne number 
of "holes" formed by the union of m convex bodies in R n . This bound was first conjectured by Laszlo 
Fejes Toth. The 2-dimensional case was proved by Katona |17j in 1977, based on an analysis of the 
shape of the convex sets, and the general case was proved by Kovalev [19J in 1988, by induction on 
dimension. We give an independent and completely different proof, which is simpler and does not 
rely on induction. Compared to the previous proofs, ours reveals the nature of the problem and 
exhibits a clear and simple reason for the bound to hold. (One can see clearly from our proof where 
each summand in the bound comes from.) The main idea and some technical tools in our proof 
are inspired by the high-dimensional Gauss-Bonnet theorem, the most important theorem in global 
differential geometry. A key concept needed in our proof is a properly defined high-dimensional 
"exterior angle", which connects the convex bodies and the "holes" at every boundary point. Our 
exterior angle differs from the standard one by Banchoff |2] by dropping all low-dimensional terms, 
but only in this way does it yield a critical identity that we need: the integral of all exterior angles 
of any bounded set, convex or non-convex, is 1. 

The dependence of the time cost of the above algorithm on the dimension is exponential. On 
the one hand, our result implies a polynomial time algorithm when the number of variables n is 
a constant. The case when n is much smaller than the number of constraints m is called fixed 
dimensional LP and is a well-studied topic [10J. Polynomial time simplex-type algorithms exist 
when d is a polynomial of logn |16|. El [20]. Linear-time algorithms for when d is a constant have 
also been developed [231 IB], and the ideas were used for many related problems, such as Euclidean 
one-center, minimum ball containing balls, and minimum volume ellipsoid problems |24tl8l 19], On 
the other hand, a natural question is whether the exponential dependence is necessary; at the very 
least, can we improve the bound to poly(m,n) + 2 poly ( n >, as Matousek et al. |20j have done, which 
is still polynomial when n is slowly growing as some polylog(m)? Unfortunately, the next lower 
bound theorem indicates that this is impossible. 

Theorem 2. Any randomized algorithm that solves the UnknownLP problem with m constraints 
and n variables needs Q,{m^ n ' 2 ^ queries to the oracle, regardless of its time cost. 

The lower bound implies that our algorithm, although of an exponential complexity, is close 
to optimal. Our proof of the lower bound uses the dual of the seminal Upper Bound Conjecture, 
proved by McMullen |21|, 122] . which gives a tight upper bound on the number of faces in an re- 
dimensional cyclic polytope with m vertices. In our proof, we construct 0{m^ n ' 2 ^ many linear 
programs with feasible solutions that are disjoint and intersect with each of the vertices of the dual 
of such a cyclic polytope. We then show that with o(mL n / 2 J) queries, we are unable to distinguish 
some of the linear programs, and thus cannot find a feasible solution. 

It is worth comparing the exponential hardness of UnknownLP with the complexities of Nash 
and CE, the problems of finding a Nash or correlated equilibrium in a normal-form game. In our 
previous work [3], we presented algorithms with polynomial numbers of queries for Nash and CE 
with unknown payoff matrices in a similar model, in which an algorithm proposes a candidate 
equilibrium and a verification oracle returns the index of a better response of some player as a 



violation. Nash and CE can be written as quadratic and linear programs, respectively, but why 
is the general Unknown LP hard while the unknown-input Nash and CE are easy (especially when 
all are given unlimited computational power)? The most critical reason is that in normal- form 
games, there always exists a Nash and a correlated equilibrium, but a general linear program may 
not have feasible solutions. Indeed, if a feasible solution is guaranteed to exist (even for only a 
random instance), such as when the number of constraints is no more than that of variables, then an 
efficient algorithm for UnknownLP does exist: see Appendix[Bj (In our algorithms for UnknownLP, 
the major effort is devoted to handling infeasible LP instances.) It is interesting to see that the 
solution- existing property plays a fundamental role in developing efficient algorithms. 

Furthest oracle. The worst-case oracle necessitates an exponential time complexity, but in some 
practical applications failed trials may reveal more violation information. For instance, in the power 
control problem all of the distances between the proposed solution point to the half-spaces of 
violated constraints can be estimated and reported. Is this additional information greatly helpful 
in reducing the computational cost? In general, what is the least amount of information about 
violations needed to solve an LP efficiently? Compared to providing all distances, the furthest 
oracle reveals only a small amount of extra information by returning the index of a most violated 
constraint. However, this turns out to be sufficient to admit a polynomial-time algorithm. 

Theorem 3. The UnknownLP problem can be solved in time polynomial in the input size in the 
furthest oracle model. 

The main idea of the algorithm is as follows. Instead of searching for a solution directly, we 
consider the unknown matrix A and vector b as a degenerate polyhedron in ]R m ( n + 1 ) ) and use the 
ellipsoid method to find (A, b). In each step we consider the center (A 1 , b') of the current ellipsoid in 
K m ( n + 1 ) J and aim to construct a separating hyperplane between (A,b) and (A 1 , b') through queries 
to the verification oracle. The main difficulty lies in the case when (A',b') is infeasible, in which 
a separating hyperplane cannot be constructed explicitly. It can be observed that upon a query 
x, with the help of the furthest oracle, the information returned from the oracle has a strong 
connection to the Voronoi diagram. Specifically, if x is not a feasible solution, then the returned 
index is always the furthest Voronoi cell that contains x. We can manage to compute the Voronoi 
diagram, but this does not uniquely determine the constraints that define the LP. To handle this 
difficulty, we give a sufficient and necessary characterization reducing the input LP to that of a 
new and homogeneous LP, for which the constraints can be identified using the structure of a 
corresponding weighted spherical closest Voronoi diagram. 

1.2 Related Work 

A considerable body of work has studied the value of information in various domains. We consider 
algorithmic computation of linear programming from the perspective of available information. Pa- 
padimitriou and Yannakakis |26j also studied solving linear programming with matrix unknown. 
However, their setting is very different from ours. They studied a specific class of linear programs, 
Ax < 1 and x > where the matrix A > 0, and considered a set of decision-makers who hold each 
of the variables and only know all of the constraints containing the variable. In addition, they stud- 
ied the problem in the distributed decision-making setting, and focused on designing distributed 
algorithms with the objective of maximizing X^ x «- Ryzhov and Powell |27j studied information 
collection in linear programming, but their unknown is the coefficients of the objective function. 



In our previous work [3], we studied the trial-and-error approach to finding a feasible solution 
for a search problem with unknown input and a verification oracle for a number of combinatorial 
problems, such as stable matching, SAT, group and graph isomorphism, and the Nash equilibrium. 
However, to bypass the computational barrier for some problems (e.g., SAT), [3j equipped an 
algorithm with a separate computation oracle, whereas in the present paper we only have the 
verification oracle. In addition, we consider not only the worst-case oracle but also a natural 
furthest oracle. Finally, our major focus is on the algorithm design in solving the UnknownLP 
problem, but the main consideration of [3] is the relative complexity of solving a search problem 
with an unknown input compared to that with a known input. 

2 Preliminaries 

Consider the following linear program (LP): Ax > b, where A = (aij) mX n E ]^ mxn anc ; = 
(61, . . . ,b m ) T E W 71 . The feasibility problem asks to find a feasible solution x E W 1 that satisfies 
Ax > b (or report that such a solution does not exist). Equivalently, this is to find a point x E M" 
that satisfies m linear constraints {djX > bi : i E [m]}, where each Oj = (an, . . . , cij n ). 

In the unknown- constraint LP feasibility problem, denoted by UnknownLP, the coefficient matrix 
A and the vector b are unknown to us, but we still need to determine whether the LP has a feasible 
solution and find one if it does. The way of solution finding is through an adaptive interaction 
with a verification oracle: We can propose candidate solutions x E M n . If a query x is indeed a 
feasible solution, the oracle returns Yes and the job is done. Otherwise, the oracle returns an index 
i satisfying aiX < bi, i.e., the index of a violated constraint. Note that we know only the index i, 
but not cij and bi, the content of the constraint. In addition, if multiple constraints are violated, 
only the index of one of them is returned. 

In the present paper, we study the computational complexity of solving the UnknownLP problem. 
As in the standard complexity theory with oracles, we assume that each query to the oracle takes 
unit time. We will analyze the complexity for two types of oracles: the worst-case oracle which 
can return an arbitrary index among those violated constraints (Section [3]), and the furthest oracle 
which returns the index of a "most" violated constraint (Section U|). 

Input size and solution precision. A clarification is needed for the size of the input. Since 
the input LP instance (A, b) is unknown, neither do we know its binary size. To handle this issue, 
we assume that we are given the information that there are m constraints^, n variables, and the 
binary size of the input instance (A, b) is at most L. Note that L is O (mn log (N)), where N is 
the maximum entry (in abstract value) in A and b. We say that an algorithm solves UnknownLP 
efficiently if its running time is poly(m, n, L). 

Given an LP with input size L = 0(mnlog(N)), it is known [18] that if the LP has a feasible 
solution, then there is one whose numerators and denominators of all components are bounded by 
(nN) n . Hence, an alternative way to describe our assumption is that, instead of knowing the input 
size bound L, there is a required precision for feasible solutions. That is, we only look for a feasible 
solution in which the numerators and denominators of all components are bounded by the required 
precision. These two assumptions, i.e., giving an input size bound and giving a solution precision 



2 Indeed, the number of constraints can be unknown to us as well: In an algorithm, we only need to track those 
violated constraints that have ever been returned by the oracle. 



requirement, are equivalent, and it is necessary to have one of them in our algorithms o In the rest 
of the paper, we will use the first one, the input size bound, to analyze the running time of our 
algorithms. 

Geometric background. The geometric concepts, notation and facts that we will use are sum- 
marized as follows. The unit sphere in R n is denoted by S n ~ 1 = {x G M n : ||x|| = 1}, where, 
throughout this paper, || • || refers to the ^-norm. 

Definition 1. A set C C M n is a convex cone if for any x,y G C and any a, (3 > 0, ax + f3y is 
also in C . The normalized volume (also called volumetric modulus) of a convex cone C is defined 
as the ratio 

i-vol„(B») 

where B n is the closed unit ball in W 1 and vol n refers to the n-dimensional volume. 

Definition 2. For any set C G M. n , its polar cone C* is the set 

C* = {y£ R" : (x,y) < 0,Vx G C). 

Definition 3. For any point set P, its convex hull conv(P) is the intersection of all convex sets 
that contain P. In particular, for any points pi,P2, ■ ■ ■ ,Pm S M. n , 

{m m ~\ 

yi \vi ■ a» > o, y^ a, = i > . 
«=1 i=l J 

We will use the following technical lemmas. 

Lemma 4 ([2H]). Let C\, C2, ■ ■ ■ , Ck be k closed convex cones, then (f] t Q)* = conv(\J i C*). 

It was shown in |25j (Lemma 8.14) that if an LP has a feasible solution, then the set of solutions 
within the ball {x G R n : ||ic|| < n2 L } has volume at least 2~( n+2 > L . Given this lemma, we can 
easily derive the following claim. 

Lemma 5. // a linear program Ax > has a feasible solution, then the feasible region is a convex 
cone in W 1 and has normalized volume no less than 2~( 2n+3 ) . 

3 Worst-Case Oracle 

In this section, we consider the worst-case oracle. Recall that in this setting, the oracle plays as 
an adversary by giving the worst-case violation index to force an algorithm to use the maximum 
amount of time to solve the problem. 



3 Otherwise, we may not be able to distinguish between cases when there are no feasible solutions (e.g., x > 0, x < 0) 
and when there are feasible solutions but the feasible set is very small (e.g., x > 0, x < e). For any queried solution 
y > 0, the oracle always returns that the second constraint is violated. However, we cannot distinguish whether it 
is x < in the first LP or x < e in the second LP, as e can be arbitrarily small and we have no information on how 
small it is. 



For any linear program Ax > b, we can introduce another variable y and transform the linear 
program into the following form: 

Ax -by > 
y>0 

It is easy to check that Ax > b is feasible if and only if the new LP is feasible, and the solutions of 
these two linear systems can be easily transformed to each other. Given the oracle for Ax > b, one 
can also get another oracle for the new LP easily. (On a query (x,y), if y < 0, return the index 
m + 1; otherwise, query x/y to the oracle for Ax > b.) This means that the UnknownLP problem of 
the homogeneous form Ax > is no easier than the problem of the general form. In all the analysis 
of this section, we will therefore only consider the problem of form Ax > 0. 

Geometric explanations. Let us consider the problem from a geometric viewpoint. Any matrix 
A = (aij) m xn can be considered as m points 01,02, . . . ,a m in the n-dimensional space M n , where 
each Oj = (oji, aj2, • • • , a m ). The positions of these points are unknown to us. Finding a feasible 
solution x € W 1 that satisfies Ax > is equivalent to finding an open half-space 

H x = {y € R n : {x, y) = x\y\ + x 2 y2 H h x n y n > 0} 

containing all points a^. 

In an algorithm, we propose a sequence of candidate solutions. When a query x G M n violates 
a constraint i, we know that (aj,x) < 0. Hence, aj cannot be contained in the half-space H x , and 
we are able to cut H x off from the possible region of Oj. Based on this observation, we maintain a 
set region (i), the region of possible positions of point <2j consistent with the information obtained 
from the previous queries. Initially, no information is known about the position of any point; thus, 
region (i) = W 1 for all 1 < i < m. 

Let us have a closer look at these regions. For each i, suppose that x\, x 2 , • • • , x\. are the queried 
points we have made so far for which the oracle returns index i. Then all information we know 
about Oj till this point is that the possible region is region(z) = f]j =1 {y £ M n : (x^y) < 0}. Since 
region (i) is the intersection of k closed half-spaces, it is a convex set. Equivalently, this means 
that any feasible solution to the LP, if existing, cannot be in region (i)* , the polar cone of region (i). 
Since the polar cone of a half-space {y € R n | (x*-,y) < 0} is the ray along its normal vector, i.e., 
{Ax* | A > 0}, we have by Lemma H] that 

region(i)* = conv([J{y \ {x),y) < 0}*J = convUXx) \ 1 < j < k, A > 0} J. 

j 

Since region (i)*'s are the forbidden areas for any feasible solution, we can conclude that the LP has 
no feasible solution if |J^ region (i)* = R n . 

Convex hull covering algorithms. Based on above observations, we now sketch a framework 
of convex hull covering algorithms that solves the UnknownLP problem. The algorithm maintains 
a list of m convex cones 

region(l)*, region(2)*, . . . , region(m)* C R n . 

Initially, region (i)* = for all 1 < i < m. On each query x E M n , the oracle either returns Yes, 
indicating that the problem is solved, or returns us an index i, in which case we update region (i)* 

7 



to conv (region(i)*, {Ax | A > 0}). The algorithm terminates when either the oracle returns Yes, or 
when W 1 — [j i region (i)* does not contain a convex cone with normalized volume at least 2~' 2n+3 * 1 , 
which indicates that the given instance has no feasible solution. The above discussion can be 
formalized into the following theorem. 

Theorem 6. Any algorithm that falls into the convex hull covering algorithm framework solves the 
Unknown LP problem. 

Though the framework guarantees the correctness, it does not specify how to make queries to 
control complexity. Next we will show an algorithm with nearly optimal complexity. 

3.1 Warraup: 2-Dimension 

To illustrate the idea of our algorithm, we consider the simplest case in which the number of 
variables is 2. In a 2-dimensional plane, using the polar coordinate system, every closed convex 
cone can be represented as an interval of angles [a, j3] where < a, j3 < 2n (e.g., [0, tt/2] represents 
the first quadrant). 

Our algorithm sets region(l)* = • • • = region(m)* = initially. At each step of the algorithm, 
assume that [0, 27r] — [J^ region(i)* = \J i=1 (ai, /%), where (ai, /3i)n (ay, /3j) = for any 1 < i < j < k. 
We pick an interval (at, fit) with the maximum fy — at, and query the oracle on point (cos (7), sin(7)) 
where 7 = (at + A)/2. Suppose the oracle returns an index i, we then update region (i)* to 
conu ( region (i)*, 7), where conv(S) here is the smallest sector containing all points in S. The 
algorithm iteratively runs the above procedure, until at some point we have (Pt — at)/ir < 2~( 2n + 3 ) , 
when we can conclude that the LP has no feasible solution. 




egion(i)* 



Consider the above figure for an example. Let us say that when we query x\ and x\, the oracle 
returns index i. Then the i-th constraint can only be in [a, b], where a and b are perpendicular to x\ 
and x\, respectively, and no feasible solution of the LP can be in [x|,a;|]. That is, region(z) = [a,b] 
and its polar cone region(i)* = [x^x^J, which is the convex hull of x\ and x\. Similarly, if x\ 
and x\ are two queries in which the oracle returns another index j, we have region (j)* = [xjjX^] 
and region(j) = [c,d\. Now given obtained information, we have [0, 2tt] — \J { region(z)* = (x\,x 3 l ) U 
(x^x?,). Among the two, (x\,x\) has the maximum length and will be picked by the algorithm. 
Then the middle point (x in the figure) of the interval (x^ , x\ ) will be picked and queried to the 



oracle. If the oracle returns index i, then region(i)* becomes [x^x]; in which case the length of 
the interval (x\,x\) is cut into half. In this example, the oracle cannot return index j since the 
entire candidate region region (j) has positive inner product with x. If the oracle returns a new 
index k, then we have region(/c)* = [a;, a;], and in the next iteration of the algorithm, we have 
[0,27r] -Ujregion(i)* = (x\,x) U (x,x{) U (x{,x' l 2 ). 

Note that first, the number of candidate intervals is at most n. Second, each query either 
increases the number of intervals or cut the length of a current interval into half. As there is a 
lower bound on the length of each interval in the algorithm (Lemma [5]), the algorithm terminates 
with a feasible solution or claims that no feasible solution exists. 

3.2 Algorithm 

In this section, we generalize our algorithm from 2-dimensional to n-dimensional. The basic idea 
is to use induction on dimension. That is, we pick an (n — l)-dimensional subspace and recursively 
solve the problem on the subspace. The subroutine either finds a point x in the subspace that 
satisfies Ax > (in which case the algorithm ends), or finds out that there is no feasible solution in 
the entire subspace. In the latter case, the whole space of candidate solutions can be divided into 
two open half-spaces, and we will work on each of them separately. In general, we have a collection 
of connected regions that can still contain a valid solution. These regions are the "holes" , formally 
called chambers, separated by (Jj region (i)* (recall that points in region(i)* cannot be a feasible 
solution). We can then pick a chamber with the largest volume, and cut it into two balanced halves 
by calling the subroutine on the hyperplane slicing the chamber. 

There are several issues for the above approach. The main one is that there may be too many 
chambers: a priori, the number can grow exponentially with m. There are also other technical 
issues to be handled, such as how to represent chambers (which are generally concave), how to 
compute (even approximately) the volume of chambers, how to find a hyperplane to cut a chamber 
into two balanced halves, etc. 

For the first and main issue, it can be shown that the number of chambers cannot be too large. 
In general, as the later Theorem [8] shows, any m convex sets in R n cannot form more than Y^l=i (T) 
chambers. For the rest technical issues, we deal with them in the following way. Instead of keeping 
track of all actual chambers, in our algorithm, we maintain a collection of disjoint sector cylinders, 
which can be shown to be supersets of chambers. This greatly simplifies the main algorithm (i.e., 
the induction part) to a procedure which is very similar to the 2-dimensional case as described in 
the previous section. Furthermore, we only keep those cylinders that contain at least one chamber, 
thus, the bound for the number of chambers also bounds the number of cylinders from above. 

The algorithm is formally given as below. We call the program AlgLP(M") to get a solution of 
the Unknown LP problem. Note that each subroutine has its own local variables, and all subroutines 
share the same global variables. 



Algorithm 1 AlgLP(F) 



Input: V: A subspace of M. n . 

Output: A feasible solution x G V, or No (solution in V). 

Global variables: region (1)*, . . . , region (to)* (initially all 0). 
Local variables: Cylinders. 



l 
2 
3 
4 
5 
6 
7 
8. 
9: 
10 

11: 

12: 
13: 
14 
15: 

16: 

17. 
18 

19: 

20 
21 
22 
23 
24 
25 



Let d be the dimension of V, and {b±, 62, • • • , bd} be an orthonormal basis of V. 
if d = 1 then 

Make two queries x = b\ and x = —b\ to the oracle. 
if the oracle returns Yes on an x then 

return x and halt the whole program AlgLP(R"). 
end if 

Update region(i)* = conv[ region (i)*, {Xx : A > 0}) for each returned i in the above queries. 
Halt the current program AlgLP(U). 
end if 

Run AlgLP({x = Y,i x ibi G V : angle(xi,x 2 ) = 0}). 
Let Cylinders = {(0,2vr)}. 
while true do 

Pick (a, (3) G Cylinders with the max /3 — a. 
if (J3 - a) fir < 2"( 2n+3 ) L then 

return No and terminate the current program AlgLP(V). 
else 

Let 7 = (a + (3)/2 and run AlgLP({x = X^Xj&j G V : angle(xi,X2) = 7}). 
Replace (a,/3) in Cylinders by (0,7) and (7,/?). 
for each element (6, A) in Cylinders do 

if {x = Y^i x ibi G U : angle(xi, x 2 ) G (5, A)} C |J^ region(i)* then 

Remove (5, A) from Cylinders 
end if 
end for 
end if 
end while 



In the algorithm, angle function is a two-argument variant of the arctangent function: angle(:c, y) 
is the counter-clockwise angle between the positive horizonal axis and the point (x, y) on the plane. 
The induction step is in line [10] and [13 where the subspaces called are defined by angle(-) of the 
first two coordinates. The algorithm either returns a feasible solution 1 in 7, or discovers that 
the entire subspace of V does not contain any feasible solution by keeping track of region (i)* . The 
algorithm thus falls into the framework of convex hull covering algorithms and always returns a 
correct answer. 

To implement induction in the algorithm, the information of an orthonormal basis of a called 
subspace can be derived from the current considered space. In particular, the subspace {x = 
Yi x ibi £ V '■ angle(a;i, 0^2) = 0} in line [TU1 is equivalent to the space expanded by the basis 
(cos(O)bi + sin(0)62> &3, • ■ • , bd), and the subspace given by angle(xi, x-z) = 7 in line [171 is equivalent 
to the space expanded by (cos(7)&i + sin(7)62, &3, ■ ■ ■ , bd)- Thus, the subspace with parameter V in 
the algorithm can be implemented efficiently. 
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Within the program with parameter V, each element (a, f3) £ Cylinders corresponds to \x = 
Y^i Xibi € V : angle(xi, X2) € (a, /3)} , which is a sector cylinder in subspace V . It can be shown that 
a cylinder surviving at the end of each while-loop iteration must contain at least one entire chamber; 
thus, the upper bound for the number of chambers, which is at most 0(m n ), also bounds the number 
of cylinders. The volume of a maximum cylinder is cut by half (line ll8p and a cylinder is disqualified 
if it is smaller than 2~( 2n+3 ) Z/ (line fT4|) . the algorithm takes at most m poly ( n > (2n + 3)L iterations in 
the while loop. Taking the recursion into consideration, there are at most 0{m poly ^ n 'poly{n) ■ Ly\ 
iterations executed. 

The above analysis leads to the following theorem, whose formal proof is deferred to AppendixlAl 

Theorem 7. AlgLP(R™) solves the UnknownLP problem in time 0(m n poly(n)-L). In particular, 
the problem, can be solved in polynomial time if the LP has constant variables. 

3.3 Counting the Number of Chambers 

Consider the union of m polytopes in R n , their complement divides the whole space M n into a 
number of disconnected components, called chambers. To analyze the running time of our algorithm, 
we need to count the number of chambers formed by m polytopes (or more generally, convex sets) . 
This question was first raised by Laszlo Fejes Toth as an open problem. The 2-dimensional case 
was proved by Katona [17] and the general case was proved by Kovalev [_1_9]. 

Theorem 8 (Kovalev [E]). The complement of the union of m open or closed convex sets in W a 
can have at most ^7=0 (T) = 0{m n ) chambers. 

The bound described in the theorem is tight: consider, e.g., when all convex sets are hyperplanes. 
The proof of Katona was based on the analysis of the shape of the convex sets, and the proof of 
Kovalev used induction on the dimension. Next, we give an alternative and simpler proof to this 
theorem. Our proof does not rely on induction and is independent to \17\ I19j . Prom our proof, 
we can see clearly where each binomial coefficient in the summation comes from. (We recommend 
readers read all these proofs for comparison.) 

We will use bounded polygons in a 2-dimensional plane M. 2 to illustrate the idea of our proof, 
which is completely elementary and much simpler than the one in |17| . Actually, we identify the 
measure of exterior angleiO to naturally bridge the number of polygons and that of chambers, and 
we only use the well-known exterior angle theorem which says that the sum of exterior angles of a 
2-dimensional polygon is 2tt. For a given polygon C, let V(C) denotes the set of vertices of C and 
let a(v,C) denote the exterior angle at vertex v, then Y1vgv<C) a i v -,C) = 2ir. 

Consider m bounded and closed convex polygons C\,C2, ■ ■ ■ , C m C M 2 . For simplicity, we 
assume that no three edges intersect at the same point. Assume that the complement of their 
union, R \ (J^ d, has k + 1 chambers Dq,Di, . . . , D^, where Dq is unbounded and D%, . . . , D^ are 
bounded polygons. Then for any vertex v G V(Dj), there are two possibilities (see Figured] for an 
illustration): 

• v is a vertex of some polygon Cj. In this case we have a(v, Dj) < < a(v, C{). 

• v is the intersection point of two edges from two polygons Cj and Cy. In this case we have 
a(v,Dj) = a(v, Ci n Cj/). 
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Figure 1: Illustration of the 2D proof. 



Hence, all exterior angles of Dj are "contributed'' 
Adding up all these exterior angles, we have^l 



by the m polygons and their intersections. 



2tt- k 






< x: E «(«.<*)+ E E «(^no,)=h- (7 +2 

i=l vGV(Ci) l<i<j<mveV(CinCj) \\ / V 

Thus, the total number of chambers is at most ^2 i=0 (™) • 

In order to generalize the proof to general convex sets in the n-dimensional space M n , one needs 
to define exterior angles for general convex sets in higher dimensions, so that it can still capture 
the intrinsic relationship between convex sets and chambers. To this end, we adapt the concept of 
"extreme directions" from Banchoff 's seminal work [2] and define the exterior angle of a boundary 
point as the set of all extreme directions at that point. Our definition of exterior angles is different 
from that of in [2j, in that we drop all low dimensional terms. The reason is that Gauss-Bonnet-type 
theorems relate total curvature to Euler characteristic, but for our purpose, the invariant of total 
curvature (i.e., exterior angle in our definition) in the highest dimension precisely links the convex 
sets and chambers. The formal proof is (unfortunately) deferred to Appendix ICl due to space limit. 

3.4 Lower Bound 

In this section, we establish an exponential lower bound for the UnknownLP problem. We will need 
McMullen's celebrated proof |21^l22j of the seminal Upper Bound Conjecture by cyclic polytopes. 
Consider the moment curve c : R — > R n that defines c(t) = (t, t 2 , . . . ,t n ) for t 6 R. For any 
distinct m > n points c(t\), . . . , c(t m ) on the moment curve, its convex hull conv(c(ti), . . . , c(t m )) is 
called a cyclic polytope with m vertices. It is known that its combinatorial structure (including the 
number of faces of any dimension) is uniquely determined by n and m, and is independent of the 



4 An exterior angle of a polygon at a vertex v is defined as the angle formed by one side adjacent to v and a line 
extended from the other side. The value is tv minus the interior angle. For a concave vertex, its exterior angle is 
negative. 

5 The second inequality only considers the intersection of two but not more CVs, because we assumed that no three 
edges intersect at the same point. When there are such three edges, it is actually to the advantage of our analysis. 
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points chosen. We use C(n, m) to denote such a cyclic polytope with m vertices in the n-dimensional 
space. 

Theorem 9 (Upper Bound Theorem (in dual form)). Let fk(P) denote the number of k- dimensional 
faces of a polytope P. For any polytope P in W l with m facets (i.e., (n — 1)- dimensional faces) and 
any < k < n — 2, we have fk(P) < fn-k-i(C(n,m)). In particular, 

MP) < fn-i(C(n,m)) = ( m ~ L ^ J ) + ( m - L ^ J ) =Q(m^). 

The upper bound theorem, in its dual form, implies an upper bound on the number of vertices 
of a polytope with m facets, and the maximum is achieved at the dual of a cyclic polytope with m 
vertices. 

Theorem 10. Any algorithm that solves the UnknownLP problem, withm constraints andn variables 
in the worst case needs at least Q{m^ n ' 2 ^) queries to the oracle. 

Proof. By Theorem [9] and the duality of polytopes, we know that the dual polytope P of a cyclic 
polytope C(n,m) has m facets and k = 0(mL n / 2 J) vertices. Equivalently, P can be defined by 
those m facet-defining half-spaces. Note that since the combinatorial structure of a cyclic polytope 
C(n, m) is only determined by m and n, the combinatorial structure of P is also fixed. 

Assume that the vertices of polytope P are v±,V2, ■ ■ ■ ,Vk- It is easy to see that for any Vi, 
1 < i < k, there exists a half-space Hi = {y G M. n : {ci,y) > d{\ which intersects P only at 
Vi, i.e., Vi = P fl Hi. Thus, ((%,Vi) = di and (ci,Vj) < d; L for all j ^ i. We now slightly move 
each half-space Hi towards the polytope P such that (i) Hi n P has a positive volume, and (ii) 
{Hi nP)fl (Hj n P) = for any i ^ j; denote the resulting open half-space by H[. 

We construct our unknown LP instances as follows. Let P' be the set of interior points of P. 
Consider the following family of LP systems LPi : |P' n H^, for i = 1, . . . , k. From the above 
analysis, we know that 

• every LPi consists of n variables and m + 1 constraints: the first m ones by P' and the last by 

Hi; 

• every LPi has a nonempty feasible region; 

• the feasible regions of LPi and LPj are disjoint, Vi ^ j. 

Next we define the adversary oracle: For any queried point p, if p ^ P', the oracle returns 
the index of an arbitrary violated constraint among the first m constraints that define P' . If 
p G P' \ [j i H[, the oracle just returns the index m + 1, meaning that the last constraint (i.e., the 
one corresponds to H^) is violated. If p G P' n H[ for some i, then the oracle also returns the index 
m + 1 if the algorithm has not made k queries yet. 

Now for any two systems LPi and LPj , the oracle will return us a different answer only if we 
propose a point in the feasible region of one of them. Because overall there are k LP systems, for 
any £ < k — 2 queries, there are at least two linear systems LPi and LPj from which we cannot 
distinguish. Thus, an algorithm has to query on at least k — 1 = £l(mL n / 2 J) candidates in order to 
solve the UnknownLP problem in the worse case. Hence, the theorem follows. □ 
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4 Furthest Oracle 

In this section, we will consider the UnknownLP problem Ax > b with the furthest oracle, formally 
defined as follows. For a proposed candidate solution x, if x is not a feasible solution, instead of 
returning the index of an arbitrary (worse case) violated constraint, the oracle returns the index 
of a "most violated" constraint, measured by the Euclidean distance from the proposed solution 
x and the half-space defined by the constraint. More precisely, the oracle returns the index of a 
constraint which, among all i with (di,x) < bi, maximizes *"iji a | i i the distance from x to the 
half-space {z G W 1 : (a,i,z) > bi}. If there are more than one maximizer, the oracle returns an 
arbitrary one. 

Compared to the worse-case oracle, the furthest oracle reveals more information about the 
unknown LP system, and indeed, it can help us to derive a more efficient algorithm. Our main 
theorem in this section is the following. 

Theorem 11. The UnknownLP problem Ax > b with a non- degenerate matrix A in the furthest 
oracle model can be solved in time polynomial in the input size. 

We call a matrix A = (ai, . . . ,a m ) non- degenerate if for each point p G S* n_1 = {x € W 1 : 
||x|| = 1}, at most n points in {-[if 1 ]]-, • • • , |i° m |i } have the same spherical distance to p on S n . This 
assumption is with little loss of generality; it holds for almost all real instances and can be derived 
easily by a small perturbation. 

Note that in the worst-case oracle setting, we can easily reduce the general LP Ax > b to 
Ax — by > by adding a new variable y. However, the same trick does not apply to the furthest 
oracle setting. This is because for a given query, the furthest violated constraint in Ax > b can be 
different from that in Ax — by > 0. Next we will first describe our algorithm for the special case 
Ax > 0, then generalize the algorithm to the Ax > b case. The formal proof of the algorithm is 
deferred to Appendix [Pi 

4.1 Algorithm Solving Ax > 

We assume without loss of generality that [|oi|| = 1 for all i. Furthermore, we can also always 
propose points in 5" 1-1 for the same reason. 

Ellipsoid method and issues. The main approach of the algorithm is to use the ellipsoid method 
to find the unknown matrix A = (ay) mX nj which can be viewed as a point in the dimension M mn , 
i.e., a degenerate polyhedron in M mn . Initially, for the given input size information m,n and L, 
we choose a sufficiently large ellipsoid that contains the candidate region of A, and pick the center 
A' € M mn of the ellipsoid. To further the ellipsoid method, we need a hyperplane that separates A' 
from the true point A. 

Consider the linear system A'x > 0. If it has a feasible solution x, then we simply query x to 
the oracle. If the oracle returns an affirmative answer, then x is a feasible solution of Ax > as 
well, and the job is done. Otherwise, the oracle returns an index i, meaning that (ctj, x) < 0. Hence, 
we have (a'^x) > > (a,i,x), which defines a separating hyperplane between A and A' (note that 
we know the information of A' and x). Thus, we can cut the candidate region of A by a constant 
fraction and continue with the ellipsoid method. 

Note that there is a small issue: In our problem, the solution polyhedron degenerates to a 
point and has volume 0. As the input A is unknown, we cannot use the standard approach in the 
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ellipsoid method to introduce a positive volume for the polyhedron by adding a small perturbation. 
This issue can be handled by a more involved machinery developed by Grdtschel, Lovasz, and 
Schrijver |13tll4j. which solves the strong nonemptiness problem for well-described polyhedra given 
by a strong separation oracle. More discussions refer to [13 | fli" } 13] . 

The main difficulty is when the LP A'x > is infeasible. In the following part of this section 
we will discuss how to find a proper separating hyperplane in this case. 

Spherical (closest) Voronoi diagram. Note that Ax > is equivalent to —Ax < 0, and i 
minimizes (at,x) if and only if it maximizes (— ai,x). In the rest of this subsection, for notational 
convenience, we use x G S" 1-1 to denote a proposed solution point, and let y = —x. Since the 
distance from a proposed solution x to a half-space {z G W 1 : (a,,z) > 0} is — (a,i,x) = (di,y), 
the oracle returns us an index i G argmaxj |(aj,y) : (a,i,y) > 0} if x is not feasible. Note that 
11-2 — Oi|| < \\z — Oj || if and only if (ai,z) > (clj,z) for any z £ S; thus, {ai,y} is closely related to 
the distance between ai and y on S n . That is, the oracle actually provides information about 
the closest Voronoi diagram of ai, . . . , a m on S n . 

Recall that the (closest) Voronoi diagram (also called Dirichlet tessellation) of a set of points 
{ai}i in a space S is a partition of S into cells, such that each point ai is associated with the cell 
{z G S : d(z, ai) < d(z,aj),Vj}, where d in our case is the spherical distance on S n ~ l . We denote 
by Vor the spherical (closest) Voronoi diagram of the points oi,... ,a m on S 11 ^ 1 and denote by 
Vor(i) the cell in the diagram associated with o«, i.e., 

Vor(t) = {z G 5™- 1 : (o,,z) > (a j} z), Vj G [m]} (1) 

= {z G S n ~ : \\z — Oj|| < \\z — aj\\, Vj G [m]}. 

If the oracle returns i upon a query x = —y G S 11 ^ 1 , then y G Vor(i). 

Representation. Note that for a general (spherical) Voronoi diagram formed by m points, it is 
possible that some of its cells contain exponential number of vertices, which is unaffordable for our 
algorithm. However, in the ^-representation of a convex polytope, every cell can be represented 
by at most m linear inequalities, as shown in Formula ([1]). In the following, we will see that the 
information of these linear inequalities is sufficient to implement our algorithm efficiently. 

Weighted spherical (closest) Voronoi diagram. For the presumed matrix A', note that it can 
be an arbitrary point in the space M. mn and may not necessarily fall into S" 1-1 . Our solution is to 
consider a weighted spherical Voronoi diagram, denoted by Vor', of points tt— frr, . . . , tttii on S 71-1 

\\ a l\\ ll a mll 

as follows: for each point -n-hi, its associated cell is defined as 

IKII 

Vor'(i) = {z G S* 1 - 1 : (a' h z) > (a^),Vj G [m]}. 

Note that Vor' is a partition of S" n_1 ; and if we assign a weight ||g^|| to each point w-hi, then for 
each point p G Vor (i), the site among ■n-ht, . . . , M T,, that has the smallest weighted distance to p 

\\ a l\\ ll a mll 

is Tphrcl Note that each cell of Vor' is defined by a set of linear inequalities (other than the unit 
norm requirement) and each of them can be computed efficiently. 



The reason of denning such a weighted spherical Voronoi diagram is that we want to have a separating hyperplane 
between A and A' = la\ , . . . , a' rn ) T , rather than ( „ }„ , .... ir-p-n ) . 
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Now we have two diagrams: Vor, which is unknown, and Vor', which can be represented effi- 
ciently using the //-representation. If Vor 7^ Vor', then there exists a point y G 5" 1-1 such that 
y G Vor(i) and y £ Vor'(i). Suppose that y G Vor'(j) for some j 7^ i. According to the definition, we 
have (di,y) > (aj,y) and (a^y) < (a'-,y); this gives us a separating hyperplane between A and .A'. 
The questions are then (1) how to find such a point y when Vor 7^ Vor', and (2) what if Vor = Vor'. 

Consistency check. In this part we will show how to check whether Vor = Vor', and if not equal, 
how to find a y as above. Although we know neither the positions of points oq, . . . , a m , nor the 
corresponding spherical Voronoi diagram Vor, we can still efficiently compare it with Vor', with the 
help of the oracle. 

For each cell Vor (i), assume that it has k facets (i.e., (n — l)-dimensional faces). Note that 
k < m and that Vor'(i) is uniquely determined by these facets. Further, each facet is defined by 
a hyperplane H[- = {z G S n ~ 1 : (a^z) = (a'-,z)} for some j 7^ i. To decide whether Vor = Vor', 
for each i and j such that Vor'(i) n Vor'(j) 7^ 0, we find a sufficiently small e y and three points y, 
y + e y , y — e y , such that 

y G Vor'(i) n Vor'(j) C H'y, y + e y G Vor'(i) - Vor'(j), y - e y G Vor'(j) - Vor'(i). 

Notice that such y and e y exist and can be found efficiently. We now query points y + e y and 
y — e y to the oracle. If the oracle does return us the expected answers, i.e., i and j, respectively, 
then, with \\e y \\ sufficiently small (up to 2~ poly ( L '), we can conclude that y must also be in the 
facet of Vor(i) and Vor(j) of the hidden diagram Vor. That is, y G Hij = {z G g™ -1 ; (04, z) = 
{clj,z)}. We implement the above procedure n — 1 times to look for n — 1 linearly independent 
points 2/1, . . . ,y n -i G Vor'(i) n Vor'(j'). If the oracle always returns the expected answers i and j, 
respectively, for all k = 1, . . . , n — 1, then we know that -ffjj = H[-. 

The procedure described above can be implemented in polynomial time. Now we can use this 
approach to check all facets of all of the cells of Vor'. If none of them returns us an unexpected 
answer, we know that every facet of every cell Vor [%) is also a facet of cell Vor(i), i.e., the set 
of linear constraints that defines Vor'(i) is a subset of those that define Vor(i). Thus, we have 
Vor(i) C Vor'(i) for each i. Together with the fact that both Vor and Vor' are tessellations of S 1 ™ -1 , 
we can conclude that Vor = Vor'. 

Lemma 12. For the hidden matrix A G R mn with spherical Voronoi diagram Vor and proposed 
matrix A' G M. mn with weighted spherical Voronoi diagram Vor', we can in polynomial time 

• either conclude that Vor = Vor', or 

• find a separating hyperplane between A and A' . 

A formal and detailed description of this consistency check procedure and its correctness proof 
can be found in the Appendix iDl 

Voronoi diagram recognization. If the above process concludes that Vor = Vor', we have suc- 
cessfully found the Voronoi diagram Vor (in its //-representation) for the hidden points ax, ... , a m . 
It was shown by Hartvigsen [15] that given a Voronoi diagram with its //-representation, a set of 
points that generates the diagram can be computed efficiently. Further, Ash and Bolker [1] showed 
that the set of points that generates a non-degenerate Voronoi diagram is unique. Therefore, by 
coupling these two results, we are able to identify the positions of ax, ■ ■ ■ , a m given the computed 
Voronoi diagram Vor, and easily determine if the LP Ax > has a feasible solution, and compute 
one if it exists. 
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4.2 The General Ax > b 

In this section, we extend our algorithm to the general case Ax > b. Due to space limit, we will 
only give the main ideas in this section and leave the formal proof to Appendix ID1 

The idea is still to use the ellipsoid method to find the unknown point (A, b), which is a 
degenerate polyhedron in R m ( n+1 ). Our goal is, for any considered point (A',b') G R m ( n+1 ) of the 
center of the ellipsoid, to compute a hyperplane that separates it from the true point (A, b). Again, 
if x is a feasible solution of A'x > b' , we can query it to the oracle and using the returned index to 
get a separating hyperplane. Thus, in the following, we assume that the LP A'x > b' is infeasible. 

Generalized furthest Voronoi diagram. Similar to the previous case, for the hidden LP Ax > b, 
we assume without loss of generality that ||a{|| = 1, for all 1 < i < to. We denote by GenVor the 
tessellation of M n into polyhedra GenVor(l), . . . , GenVor(m), where 

GenVor(i) = [x G M n : b{ - {a i} x) > bj - (a.j,x), j G [m]}. (2) 

Note that different from the Ax > case, GenVor is no longer a spherical closest Voronoi diagram; 
it can be seen as a generalized furthest Voronoi diagram over M. n where each source site is a half- 
space. It follows that for any query x G M. n , if x is not a feasible solution to the LP Ax > b, the 
oracle always returns an index i where x G GenVor(i). 

For any presumed point (A', b') G ]R m ^ n+ \ we compute 

GenVor'(i) = {x G M. n : b' t - (a'^x) > b) - (a' p x), j G [to]} (3) 

and denote GenVor' = {GenVor'(l), . . . , GenVor'(m)}. Similar to the previous case, if GenVor ^ 
GenVor', we want to find a point x G M. n such that x G GenVor(i) and x G GenVor' (j) for some 
i 7^ j; this gives us bi — (a,i,x) > bj — {aj,x) and b\ — {a' i7 x) < &'■ — (a'-,x), with at least one of 
the inequalities strict. Thus, we have a separating hyperplane between (A,b) and (A',b'). Again 
because each cell GenVor' (i) (as well as GenVor(z)) is a polytope defined by a set of linear inequalities, 
and GenVor' and GenVor are a tessellation of the space M n , we can apply the same procedure as 
the Ax > case to check whether GenVor = GenVor' in polynomial time (even if GenVor' (i) or 
GenVor(i) is empty). 

However, even after finding the tessellation GenVor for the hidden LP Ax > b, i.e., GenVor = 
GenVor , we still cannot recover the actual instance A and b from GenVor even all half-spaces are non- 
degenerate. For instance, for any scale c£l, the two systems Ax > b and Ax > b + {c, c, . . . , c} T 
have the exactly same tessellation GenVor, but they may have different feasible solutions. In the 
following, we will show that when GenVor = GenVor', we are able to focus on a particular point in 
R n , and use the claims proved in the previous section to solve the problem. 

Extreme point. Given a matrix A and a vector 6, define 

d(A,b) = min | max{6j — (oj,x}}}, and (4) 

extreme(A, b) = {i£l": max{&; - (oj,x)} = d(A,b)}. (5) 

Notice that d(A,b) may be unbounded for general A and b, e.g., when Ax > b has an unbounded 
feasible region. For such a case, we define d(A, b) to be — oo and extreme(j4, b) = 0. But when 
Ax > b is infeasible, extreme(^4, b) is always nonempty and d(A, b) is bounded by from below. 
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The definition of extreme(A, b) gives the set of points that minimizes the maximal distance from 
which to all half-spaces {z G M. n : (oj,,z) > bi}. Note that given matrix A and vector b, both d(A, b) 
and a point in extreme(^4, b) can be computed efficiently through linear programming. (The value 
d(A, b) is an LP and extreme(^4, b) is the union of the feasible regions of m LP's.) 

The next lemma links the homogeneous and non-homogeneous forms and will be later used to 
decide the infeasibility. 

Lemma 13. A linear system Ax > b is infeasible if and only if there is a point p G M. n such that 

• p is not a feasible solution of Ax > b, and 

• the linear system {(ai,x) > : % G S}, called the support linear system of Ax > b at p, is 
infeasible, where S is the set of the indices of the half-spaces in the LP Ax > b that has the 
(same) maximal distance to point p. 

Further, if Ax > b is infeasible, then any point in extreme(yl, b) satisfies the above two conditions. 

The proof of the lemma is deferred to Appendix ID.ll We will use the lemma to infer that 
the hidden linear system Ax > b is infeasible. For the considered LP A'x > b', as it is infeasible, 
extreme^', b') ^ 0; we then compute an extreme point p G extreme^', &'). 

Now, if we focus on the region around p and limit our queries within the ball B = {z G M. n : 
\\z — v\ < £*} for some small enough e* > 0, then for each query x = p + x' within the ball B, 
where \\x'\\ < e*, the oracle returns an index 

i G arg max { bi — (aj , x) } = arg max { bi — (<Zj , x) } 

ie[m] i£S 

= argmaxjbj - (aj,p) - (ai,x')\ = argmaxj - (ai,x')\, 

i€S L ' ieS L ' 

where the first equality is because e* is sufficiently small, and the last equality follows from the 
fact that all half-spaces in S have the same maximal distance to p. Thus, for any queried point 
within this ball B, the set of indices possibly returned by the oracle for Ax > b is the same as 
that by the furthest oracle for the support linear system {(aj,x) > : i G S}. This means that 
the Voronoi structure GenVor in B is exactly the same as the weighted spherical Voronoi diagram 
GenVor' for the corresponding support system in B. Then, by the results in previous section, we 
are able to identify the exact values for all Oj in S; that is, the support system {(aj, x) > : i G S} 
is revealed. The last step is straightforward: if the support system is infeasible, then by Lemma [T3l 
we can conclude that LP Ax > b is also infeasible. If the support system has a feasible solution x*, 
since we know x* is not a feasible solution to {(a'^x) > : i G S} (by Lemma [TB")) . we must have 
(a^x*} < < (ai,x*) for some i G S, which is a separating hyperplane between (A,b) and (A',b'). 

Putting things together. To summarize the above discussions, in our algorithm we employ 
the ellipsoid method to search for (A,b) G M m ' n+ >. In each iteration of the ellipsoid method, we 
propose the center (A',b') G M. m ^ n+1 ' (with a possible perturbation) of the current ellipsoid, and 
apply the following procedure: 

1. If A'x > b' is feasible, find a solution x to it and query x to the oracle, then use the returned 
index to construct a separating hyperplane. 

2. Otherwise (i.e., A'x > b' is infeasible), do the following. 
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• Compute the generalized Voronoi diagram GenVor' of A' and b' , and confirm that GenVor = 
GenVor'. 

• Compute a point p € extreme(v4', b') and the corresponding support S, then confirm that p 
is an infeasible solution to Ax > b. 

• Focus on a small ball B centered at p and use GenVor = GenVor' in B to recover the support 
linear system at p. Then confirm that the support system is infeasible, and, by Lemma [T3| 
conclude that the hidden LP Ax > b is also infeasible and terminate the whole program. 

If we get an "unexpected" answer from the oracle at any step of the above procedure, then we 
either receive a Yes from the oracle and thus solve the problem, or get a hyperplane that separates 
the unknown (A, b) and current center (A', &'), in which case we jump out of the current iteration 
and continue with the ellipsoid method with a smaller ellipsoid. From the above discussions, we 
know that every step can be implemented in polynomial time. Hence, the problem can be solved 
efficiently. 

A complete description of the algorithm and its formal proof can be found in Appendix |Dj 

5 Concluding Remarks 

Although the discussions thus far have been for the LP Ax > b, our techniques and results also 
apply to the form of Ax > b. The major differences are (1) whether the bodies considered are 
open or closed, and (2) that the feasible region of the LP now may not be of full dimension. As 
when handling the standard LP using the ellipsoid method, these issues can be handled by a more 
careful treatment of the boundary conditions. In particular, when a considered possible solution 
region is sufficiently small, we can safely conclude that there is no feasible solution in the region 
with required precision. 

We consider solving linear programs when the input constraints are unknown, and show that 
different kinds of violation information yield different computational complexities. Linear programs 
are powerful tools employed in real applications dealing with objects that are largely unknown. For 
example, in the node localization of sensor networks where the locations of targets are unknown [7J, 
the computation of the locations in some settings can be formulated as a linear program with con- 
straints that measure partial information obtained from data [12J. However, the estimation usually 
has various levels of error, which may lead to violations of the presumed constraints. Interest- 
ing questions that deserve further explorations are what can be theoretically analyzed there, and 
in general, what other natural formats of violations there are in linear programming and what 
complexities they impose. 
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A Proof of Theorem [7] 

Proof. We prove the following property by induction: when called on a parameter V, the program 
either returns a feasible solution x in V, or discovers that the entire subspace V does not contain any 
feasible solution. Once this is proved, applying it to the case dim(V) = 1 gives the correctness of the 
algorithm. The induction base is trivially true. Suppose that the claim is true for dim(V) = d— 1, 
and we consider the case for dim(V) = d. It is not hard to see that the algorithm falls into the 
framework of convex hull covering algorithms: Starting from region(i)* = 0, the algorithm proposes 
queries (line [3]) and uses the returned violations to update region(i)*'s (line [7]). Thus, Theorem [6] 
guarantees the correctness of the algorithm, as long as the algorithm always terminates. We will 
show this together with the complexity analysis below. 

Within the program with parameter V with an orthonormal basis {b±, 62, ... , bd}, each element 
(a, /3) G Cylinders corresponds the set 



X> 



Xi G V 



angle(xi,x 2 ) G (a, (3) 



which is a sector cylinder in subspace V. Each cylinder surviving at the end of each while-loop 
iteration intersects with some chamber, because otherwise it is in |L region(i)* and thus has been 
eliminated in line [2TJ Note that the boundary of the sector cylinder (a, /3) are the two {d — 1)- 
dimensional subspaces 



and 



V a = < x = ^6jXj G V angle(xi,x 2 ) = a > 

^ i ' 

Vp = I x = Y^biXi G V angle(xi,x 2 ) = fi\ 



both of which have been searched in the previous loop iterations for feasible solutions. By induction 
hypothesis, either a feasible solution has been found and the whole program has ended, or we have 
known at this point that the two subspaces do not contain a feasible solution. Since a chamber 
intersects with the cylinder, but not with the cylinder's boundary, we can conclude that the cylinder 
contains at least one entire chamber. Therefore, when all cylinders are too small to contain any 
feasible region (line ll4p . we can conclude that the current subspace V does not contain any feasible 
solution. To be more precise, first, note that the normalized volume of a sector cylinder 

{x G M n : ||x|| = l,angle(xi,x 2 ) G (a,/3)} 

is the same as that of a 2-dimensional sector 

{x G M 2 : ||a?|| = l,angle(xi,x 2 ) G (a, (3)}, 

both equal to (/3 — a)/2ir. Second, in general it is not true that a set S of small volume cannot 
contain a solution. But the set in our case is the sector cylinder, and the induction hypothesis 
guarantees that the boundary (the two half-subspaces corresponding to angle(xi,x 2 ) = a and j3) 
do not contain any feasible solution. Thus the cylinder either contain no feasible solution, or the 
entire convex cone of the feasible region in Lemma [5j 
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Since each cylinder contains at least one entire chamber, and different cylinders clearly do not 
intersect, the upper bound for the number of chambers also holds for the number of cylinders. As 
each time the volume of the maximum cylinder shrinks by half (line [T8|) until it is smaller than 
2 -(2n+3)L (ii ne [33^ by Theorem the algorithm takes at most Yh=q (?)( 2n + 3 ) L iterations in 
the while loop. Taking the recursion into consideration, there are at most 

n d , \ 

n E(7) (2n+3)L=o ( mn2n2L ) 

iterations executed. 

Inside each loop, the only steps other than the subroutines that cost more than a constant 
amount of time is at line l20| which is to check whether \J i region(i)* contains some set. Here 
we briefly argue how to do it in 0(m n ) time. Each region (z)* has at most m n facets and thus 

U^ region(i)* has at most r™ ) < m n vertices. These vertices can form at most (!", 1) = 0{m n ) 
simplexes, which are convex. For each of these potential simplexes, pick an arbitrary interior point 
p and check whether it is outside \J { region (i)*. 

Therefore, the whole algorithm ALGLP(M n ) has running time 0(m n n 2 L). □ 

B Small Number of Constraints 

In this section, we consider those LP instances Ax > b in which the number of constraints m is 
less than or equal to the number of variables n. Note that such LP instances possess an important 
property that a feasible solution almost surely exists. In the following we will see that, in contrast 
to the exponential lower bound established for the general setting, the solution-existing (almost 
everywhere) property yields an efficient algorithm for the Unknown LP problem. 

Theorem 14. The Unknown LP problem with m constraints and n variables can be solved in poly- 
nomial time with respect to the input size when m < n. 

Proof. We use the ellipsoid method to find the unknown matrix A and vector b, which can be 
together viewed as a point (also a degenerate polyhedron) in dimension M. m ( n+ '. Initially, we 
choose a sufficiently large ellipsoid that contains the candidate region of the point (A, b). During 
each iteration of the algorithm, we pick the center (A', b') € M m ' n+ > of the current ellipsoid. 

If the LP A'x > b' has a feasible solution x, then we simply query x to the oracle. If the oracle 
returns Yes, then x is also a feasible solution to Ax > b, and the job is done. Otherwise, suppose 
that the oracle returns an index i, then we know that (aj,x) < bi and (a'^x) > b^, which gives a 
separating hyperplane. 

A problem arises when A'x > b' is infeasible, in which case we cannot find a separating hyper- 
plane directly. However, notice that when m < n, a linear program A'x > b' is always feasible if 
the matrix A' is full rank. Also, for any matrix A' and any e > 0, we can easily find a full rank 
matrix A" such that the difference between any entry of A' and A" is at most e. Then, by querying 
a feasible solution of A"x > b', we actually get a separating hyperplane between (A" , &') and (^4, b). 
Since {A" , b') can be arbitrarily close to the center point (A' , b') of the current ellipsoid, we are still 
be able to use the original ellipsoid argument to claim that the volume of the ellipsoid uniformly 
decreases at every step. 
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Finally, notice that the solution polyhedron degenerates to a point and has volume 0. We can 
use a machinery developed by Grotschel, Lovasz, and Schrijver |13|. E] to handle this issue. The 
same idea has been used in solving Unknown LP in the furthest oracle model. 

Thus, the UnknownLP problem can be solved in polynomial time when m < n. □ 

C Proof of the Chamber Counting Theorem 

In this section, we will give a formal proof of Theorem [8] for counting the number of chambers in the 
general n-dimensional space. We first define direction vectors in M. n and their indicator functions; 
these definitions are inspired by Banchoff's seminal work [2]. 

Definition 4. For a given closed set C in W 1 , a vector v e M n is called general if there is x € C 
such that (v, x) > (v, y) for any y € C and y ^ x. That is, x is the unique extreme point in C along 
the direction v. Note that x, if existing, must he at the boundary of C, denoted by dC. Define an 
indicator function f v (p,C) by f v (p,C) = 1 if p is such a unique extreme point, and f v (p,C) = 
otherwise. 

By the definition, it was shown in [2] that if v is general for a bounded set C, then J2 P edC fv{P-> C) : 
1. Let duj 71 " 1 be the ordinary volume element on the sphere of the unit ball in M n , denoted by 

S n-1 = | p g R n . || p || = ^ &nd ^ y = J^^ ^n-1 bg the volume Q f gn-1 Note that thfi int eg ra l 

f S n-i can be considered as either over all points in 5™ _1 or over all direction vectors, i.e., f v€S n-i- 
Then for any nonempty bounded convex set C C M n , it holds that 

V=f <L; n - l =[ Y.f^ C ) dhjn ~ X =Y,j i fv( P ,C)du n - 1 . (6) 

That is, the summation of the indicator functions over all points on the boundary of C over all 
directions equals to the volume of S' n_1 . 

Bound the unbounds. Note that Equation © does not hold when the set C is unbounded. 
The major effort in our proof is devoted to dealing with unbounded convex sets, described in the 
following. We add a ball B(r) = {p£ W 1 : ||p|| < r} with radius r sufficiently large to satisfy the 
following conditions. 

• All bounded convex sets are contained within B(r). 

• At any intersection point between the boundary of an unbounded convex set and the sphere 
of B(r), a supporting hyperplane of the convex set is "almost" perpendicular to the tangent 
hyperplane of B(r) at that point. Formally, for any point p £ dCiDdB(r) for some unbounded 
convex set Cj, let the unique supporting hyperplane of B at p be {x € M. n : (p, x) = b}, then 
the distance between (1 — e)p and the supporting hyperplane of Cj is when r approaches 
infinity. This implies that for any x which is not linear to p, if lim p + x G C{ fl B(r), 

r— » oo 

then lim p + ref (x,p) is not an interior point of Cj n B(r) (see Figure l2b|) . where ref(x,p) = 

r— >oo 

(2pp — I)x reflects x across the line that goes through the origin and p and I is the identity 
matrix. 



21 



Given the big ball B(r) described as above, let C[ be the closure of set CiHB(r) for all 1 < i < m; 
note that all sets C[ are now closed and bounded. Let 

D'=(R n \[jC^nB(r) 

i 

be the complement of the union of these convex sets within the ball B{r). Note that the number of 
chambers in D' and that in D = W l \ |J^ Cj is the same. Suppose that D' has k chambers, and let 
D[, . . . , D' k be the closure of each chamber (which are all bounded) 13 Next we partition all points 
in \JjdD'- into three categories: 

• r B = { P e u, dD'j \ P £dB,pi{j t dc>}. 

•r c = {pe Ui dD] \p<£dB,p€ Ui 9Ci}. 

• r BC = { P e Uj dD' | v g dB, P g U del}. 

We next prove a key lemma used in our proof. Note that we can assume that any XX and D'-,, 
j 7^ j', do not intersect; indeed, we can expand all the closed sets Cj by a small e and this does not 
decrease the number of chambers. 

Lemma 15. For any chamber D'-, any p G dD'-, and any vector v G W 1 , the following properties 
hold. 

(1) IfpEV B ,f v {j>,D> j ) = f v {jp,B). 

(2) Ifpe Y C , W, ty < f- v (p, P[i; P edc> C') ■ 

(3) Ifp£T BC , lim ^(p^D'-) < lim / re f(„ p) ( p, flrpeSC? C 'i 

Proof. We prove the claim for each case respectively. 

(1) Both sides equal to 1 if v = Xp for some A > 0, and both are otherwise. 

(2) Let I = {i G [to] | p G C 4 '}. If the right hand side of the inequality is 0, then there is another 
point w G Uiej C[ with (p, —v) < (w, —v). Let w = p + x. We pick a small enough e > 0, 
such that p' = p — ex ^ C'- for any j ^ I (see Figure l2al) . At the same time, for any i G I, 
p' $l C[ as well, because there is a separating hyperplane such that C[ is entirely at one side, 
and thus, p' cannot be an interior point of C[. So p' G D'- as we assumed that two ZX-'s do 
not intersect. Now (p',v) = (p,v) — e((p,v) — (w,v)) > (p,v), thus, f v (p,D'-) = 0. 

(3) We use a similar argument as above. If the right hand side of the inequality is 0, then there 
is another point w G Uie/ C'i with (p, rei(v,p)} < {w, ref(v,p)}. Let w = p + x. We pick a 
small enough e > 0, such that p' = p + e(ref(x,p)) G" C' for any j ^ I (see Figure l2b|) . At the 
same time, when r is large enough, for any i£l, because p + ex G C[, which implies that p' 
is not an interior point of C[. Then we know p' G D'-. Thus, (p' , v) = (p, v) + e(ref (x,p), v } = 
{p, v) + e(ref(v,p),x) > {p,v}, which implies f v (p,D'-) = 0. 



7 Note that the definitions of all C[ and D'j depend on the radius of the ball B(r). That is, precisely, they should 
be C'i(r) and Dj(r). In our discussions, for simplicity, we ignore the parameter r, and note that r is always sufficiently 
large. 
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rel(v,p) 




(a) Point p G T c 



(b) Point p S T B C- 



Figure 2: Illustration of the boundaries. 

This completes the proof of the lemma. □ 

In addition, notice that for any point p, direction vector v' and bounded set C, we have 



/ 



f v (p,C)du 



n-l 



f-v{p,C)dw 



n-l 



fref(v,v>){P,C)dLJ 



n-l 



This fact, together with the above lemma, implies the following important corollary. 
Corollary 16. For any chamber D'- and p E dD'-, the following hold. 

(1) Ifpe T B , then J^ f v (p, DJ.) dw" 1 ' 1 = f^ f v (p, B) duj n ' x . 

(2) IfpeTcU r BC , then j sn _ x lim f v (p, D>) du^ 1 < L^ lim /„ (p, (\ vedC , C'A duj n '\ 

Before proving the main theorem, we need to handle degenerated cases in which some points 
are at the boundary of more than n convex sets. 

Lemma 17. For any point p E M. n , let S = {Cj | 1 < i < m,p E <9Cj} be the set of convex sets 
whose boundary contains p. If \S\ > n, then for any vector v that is general to all these convex 
sets, 

fJ P ,f]c)< Yl fvUpi c )- 



CeS 



S'CS,\S'\=n 



ces' 



Proof. For notational convenience, we shift the origin of the coordinate system to p. An important 
observation is Note that for any convex set C with p E dC, f v (p, C) = 1 if and only if v is contained 
in the polar cone of set C. Thus, by Lemma HI we know that /u(p, flces^) = 1 if an Y only if 
v E (flceS^) = conv {^Jc^s ^*) ■ Combining this with the fact that for any set S of more than 
n cones in R" - , conv(S) = {J s/( - s i S n =n conv(S'), we know that f v (p, flees 1 C) = 1 then there must 
exist S' C S, \S'\ = n, such that f v (p, flees' C) = I. D 
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Now the main theorem can be proved by a simple counting argument. 

Proof of Theorem^ As discussed above, assume there are k chambers caused by T = {C[, . . . , C' m } 
(which are all bounded). Then we have 

k 



k = YrJL J2 [ MPiD'^du; 71 - 1 (Equation® 

= 7?( E + E + E )/ fvip, D'j) du; n ~ 1 (j is the unique one with p e D\ ■) 
^per B p£T c v£T BC ' Js"-' 1 

< ^V/ f v {p,B)du n ~ 1 + ^ V / lim/Jp, f| C'^dm"- 1 (Corollary [HD 

V * — ' I qn-l V *■ — ' / cn-1 r->-oo \ II / 

TrU I fv(p,B)dw n ~ l + b E E / lim /Jp, f| trW^ 1 (LemmaE} 



< 
y 

0<|S|<n 



1+ ^ 1 (Equation [BJ 



SCT 
0<|S|<r 



E 



i=0 

Therefore, the theorem follows. □ 

D Furthest Oracle Algorithm: Formal Specifications and Proofs 

We give formal description of algorithm and proof of its correctness and complexity in this section. 
In Section ID.H we show a proof of Lemma [T3l In Section ID. 2\ we give a procedure to check the 
consistency of two furthest Voronoi diagrams, which will be used in the main algorithm given in 
Section ID. 31 

D.l Proof of Lemma 1131 

Proof. On the one direction, assume that Ax > b is infeasible. For any point p E extreme^, b), by 
definition, p is not a feasible solution of Ax > b. Suppose for the sake of contradiction that the 
support linear system {(a.i,x) > | i G S} contains a feasible solution x € M. n . Consider x' = p + ex 
for a small e > 0. We have 



max 



{bi - {ai,x')} = max{6j - (oj,p) - e • (ch,x)} < d(A,b). 



This contradicts the fact that p € extreme(^4, b). Thus, we know that {(aj,x) > | i £ S} is 
infeasible. 

On the other direction, let 

d! = max{6j - (oj,p)}. 



iSm 



Since p is not a feasible solution of Ax > b, we have d' > 0. By the definition of 5, we know that 
for any i € 5, bi — {ai,p) = d' > 0. Now consider any point x € R n , let x' = x — p. Since there 
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exists an index i £ S such that (a; L ,x') < 0, we have 

bi - (oj,x) = h- (cLi,p) - (a,i,x') >d' + 0>0 

This means that x is not a feasible solution to Ax > b. Thus, we conclude that Ax > b is 
infeasible. □ 

D.2 Consistency Check between Voronoi Diagrams 

To specify the main algorithm, we need a subprocedure VorCheck to check whether the furthest 
Voronoi diagram of the unknown (A, b) is the same as that of a proposed {A' , b'). We will describe 
the procedure with respect to the general Ax > b case, and the discussions in Section |4J] for Ax > 
can be considered as a special case. (Recall that the input instance has m constraints, n variables, 
and binary size L.) 

Procedure 2 VorCheck {A',b') 
Input: Presumed point (A',b') 
Output: Yes, or a separating hyperplane (between (A, b) and (A', b')) 

1: for each pair i,j£ [m] and i ^ j do 

2: if GenVor'(i) n GenVor'(j) / then 

3: Solve the following LP feasibility problem and get a solution y^': 

b\ - K,y) = b) - (a' p y) > b' k - (a' k ,y) + 2~ WL ^k + i,j (7) 

4: Take an orthonormal basis z^ 2 \ . . . , z^ n ' of the affine subspace H[, D GenVor'(i) n GenVor'(j). 
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for each k € {2, ...,n} do 

Lety^=y^ + 2- WL -z^. 

Find e- k > (the absolute value of each of its component is bounded by 2~ 2L ) to satisfy the 

following inequalities Eq.([5J) and @. 

b' t - (oU (fe) + e (fc) ) >b' e - (a' e ,yW + e«),W + i (8) 

b) - {a' p y^ - e«) > 6^ - <<4y« - e<*>>, W ^ j (9) 

end for 

for each k £ [n] do 

Query j/W + gW and j/W — e^ k ' to the oracle, and get answers i' and j', respectively. 
if i' ^ i or j' ^ j then 

Output the corresponding separating hyperplane. 
end if 
end for 
end if 
end for 
Output Yes 
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Lemma 18. // GenVor'(i) 7^ for all i, then the procedure VorCheck either finds a separating 
hyperplane between (A',b') and (A, b), or confirms that GenVor = GenVor'. 

Proof. In the procedure VorCheck, for each (i,j) with GenVor'(i) n GenVor' (J) ^ 0, we first find 
n — 1 linearly independent points in GenVor'(i) n GenVor' (j), and then check that they are also in 
GenVor(i) n GenVor(j). We achieve this by finding a pair of points y{> ± e'" and verify that they 
are in GenVor(i) and GenVor(j), respectively. Then because of the assumed precision for (A,b), we 
know that j/W € GenVor(i) nGenVor(j). Hence, after Step HU in VorCheck (A', If), we can conclude 
that the hyperplane H[- also contains GenVor(i) n GenVor(j). 

Now consider each nonempty GenVor' (i). It is the intersection of k < m — 1 half-spaces with 
boundary H[p and each of these iTy's is equal to the corresponding boundary hyperplane Hij in 
GenVor. Thus, we know that GenVor(i) C GenVor'(i) as the former is the intersection of possibly 
more half-spaces. But both GenVor and GenVor are a partition of M n , together with the fact that 
all GenVor' (i)'s are nonempty, we have GenVor = GenVor'. □ 

The procedure VorCheck (A',b') checks whether GenVor = GenVor', assuming that GenVor'(i) 7^ 
for all i. However, if GenVor'(i) = for some i, but VorCheck does not know whether GenVor(i) is 
empty. Our solution to this issue is to simply ignore these indices % that are not in T and pretend 
that the unknown LP does not have these constraints. If at any point the oracle outputs some i 
that is not in T (i.e., with GenVor'(i) = 0), then we get a separating hyperplane. Otherwise the 
algorithm just runs as if these z's do not exist: We either find some other separating hyperplane or 
a valid solution to the unknown LP, or confirm that the unknown LP restricted to T is infeasible, 
which implies that the original LP is also infeasible (since it needs to satisfy even more constraints). 

D.3 Main Algorithm 

Now we are ready to describe the main algorithm Furthest Alg, which uses the ellipsoid method 
to search for (A, b) E M"H n+ ) in order to solve the general UnknownLP problem Ax > b. In the 
algorithm, whenever we find a hyperplane that separates the unknown (A, b) and the center (A 1 , b') 
of the current ellipsoid, we use "continue" to denote the standard procedure of proceeding to the 
next iteration of the ellipsoid method with a smaller ellipsoid. Whenever we find a solution x with 
Ax > b, we use "terminate^)" to mean to terminate the whole program with an output x. We also 
use "terminate(No)" for terminating the whole program with No, i.e., no feasible solution exists. 
We use B(p,e) to denote the ball centered at p with radius e. 
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Algorithm 3 FurthestAlg 



Input: an unknown LP Ax > b 

Output: a valid solution x for Ax > b, or No. 
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Run the ellipsoid method to search for (A, b) G M m ( n+1 ). 
for each iteration of the ellipsoid method do 
Let (A',b') be the center of the current ellipsoid. 
if A'x > b' is feasible then 

Find a solution x to it and query x to the oracle. 
if the oracle returns Yes then terminate(x). 

else suppose that the oracle returns i, then we get a separating hyperplane 
"ajX < bi and a[x > b'" and continue, 
else 

Define GenVor and GenVor' by Eq.© and ©, and let T = {i : GenVor'(i) / 0}. 
Run VorCheck (A' , 6'). If it outputs a separating hyperplane, then continue 
Compute a point p G extreme(A', b') and the corresponding support S. 
Query p to the oracle. 
if the oracle outputs Yes then 

terminate^). 
else if the oracle outputs an i £ T then 

we get a separating hyperplane and continue. 
else 

Use GenVor = GenVor' in B(p, e) for a sufficiently small e to recover {(aj, x) > : i G S}. 



19: if {{<n,x) > : i G S} is feasible then 

20: Compute a feasible solution x*, and suppose {a^x*) < for some i G S. We get a 

separating hyperplane "(a^,x*) < and (aj,x*) > 0" and continue. 
21: else 

22: terminate(No). 

23: end if 

24: end if 

25: end if 
26: end for 

Theorem 19. Algorithm FurthestAlg solves the UnknownLP problem Ax > b with the furthest oracle 
in polynomial time. 

Proof. We will prove the correctness and analyze the complexity along the way. The whole algo- 
rithm runs the ellipsoid method to search for (A, b) G ]R"^ n+ > . For the center (A' , V) of the current 
ellipsoid, if the LP A'x > b' is feasible, then we can find a solution x to A'x > b' in polynomial 
time. If this x is also a solution to the unknown LP Ax > b from the query to the oracle, then 
the algorithm successfully finds a feasible solution; thus, it outputs x and terminates. If the oracle 
returns some i, it means that a^x < bi, then together with a\x > b[, we get a hyperplane that sep- 
arates (A, b) and (A', b') in R m ( n + > . Thus, we can go to the next iteration of the ellipsoid method. 
Therefore, the hard case is when the LP A'x > b' is infeasible, which will be our assumption for 
the rest of the proof. 

Define GenVor and GenVor' by Eq.([2]) and ([3]). The procedure VorCheck (A',b') checks whether 
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GenVor = GenVor', assuming that T = {i : GenVor' (i) 7^ 0} = [m]. By Lemma [THl if T = [m], then 
either the procedure finds a separating hyperplane for (A, b) and (A', b'), or confirms that GenVor = 
GenVor'. If T ^ [m], then some GenVor'(z) = 0, but VorCheck does not know whether GenVor(i) is 
empty too. Our solution to this issue is to simply ignore these indices i not in T and pretend that 
the LP does not have these constraints. If at any point (of the current ellipsoid iteration, i.e., for 
the current (A',b')), the oracle outputs some i that is not in T (i.e., with GenVor'(i) = 0), then 
we get a separating hyperplane (because in (A',b') the distance b\ — {a[,x) is always smaller than 
bj — {a'j,x) for some j). If in other steps of the algorithm, i.e., at Step 10 of VorCheck (A',b') and 
Step 16 of FurthestAlg, the oracle never returns an i G [m] \ T, then the algorithm just runs as if 
these i's do not exist: We either find some other separating hyperplane or a valid solution to the 
unknown LP in some other steps, or we confirm that the unknown LP restricted to T is infeasible, 
which implies that the original LP is also infeasible (since it needs to satisfy even more constraints). 

Next we show that one can compute a point p G extreme(^4',6') and the corresponding support 
S in polynomial time, which are defined by Eq.Q and ([5]). From Eq.@, we see that when A'x > b' 
is infeasible, d(A',b') > 0. Since Eq.(j4|) can be expressed as an LP (minz s.t. bi — (a,i,x) < z, 
Mi G [m]), we know that the minimum is always achievable and can be computed in polynomial time. 
Then, from Eq.([5]), one can search over all i G [m] for an x satisfying that bi — (ai,x) = d{A' , b') > 
bj — {dj, x), \/j^i. Finally, it is easy to fix S as the set of indices i with bi — (a,i,x) = d(A', b'). 

Now that we have found a point p G extreme(^4',6 / ); if p happens to be a solution of Ax > b, 
then we are done. Below we focus on the situation that Ap > b does not hold. By Lemma [131 
it suffices to show that the support linear system of Ax > b at p is infeasible. Let S (and S' , 
respectively) be the set of the indices of the half-spaces in Ax > b (and A'x > b', respectively) that 
have the (same) maximal distance to point p. Since GenVor = GenVor' and the set of indices that 
have the (same) maximal distance to some point solely depends on the Voronoi diagram, we know 
S = S'. Consider the corresponding support linear system {(aj, x) > : i G S} for the unknown LP 
Ax > b. We pick a small enough e* > such that for any i ^ S, e* < d— {b. L — {ai,p)). (Notice that 
though we do not know the hidden (A,b), the assumed precision implies a minimum possible gap 
between the largest distance d(A, b) and the second largest distance max^/a^^MM b{ — (ai,p). 
It is not hard to see that this gap is singly exponentially small, thus we can take an e smaller than 
this gap using polynomial number of bits.) 

Now, if we focus on the region around p and limit our queries within the ball B = {z G M. n : 
\\z —p\\ < e*}, then for each query x = p + x' within the ball B, where \\x'\\ < e*, the oracle returns 
an index 

i G arg max {bi — (oj, x) } = arg max { bi — (oj , x) } 

ie[m] ' ieS 

= arg max j bi — {di,p) — (a^, x') } = arg max j — (o^, x') \ , 

where the first equality is because when e* is sufficiently small, the maximum is always achieved 
by some i G S, by the definition of S. The last equality follows from the fact that all half-spaces 
in S have the same maximal distance to p. Thus, for any queried point within this ball B, the set 
of indices possibly returned by the oracle for Ax > b is the same as that by the furthest oracle for 
the support linear system {{a,i,x) > : i G S}. This means that the Voronoi structure GenVor in 
B is exactly the same as the weighted sphericajj Voronoi diagram GenVor' for the corresponding 
support system in B. Note that the non-degenerency assumption of (A,b) holds in the ball B as 



Recall the assumption of ||a-;[| = 1, for all i £ [m], for both Ax > in Section \4. II and Ax > b in Section [4~2 
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well. Thus, by the results in Section T4.ll we are able to recover all aj for i € S; namely the support 
system {(ai,x) > : i € S} is revealed. The last step is straightforward: if the support system is 
infeasible, then by Lemma [T3l we can conclude that LP Ax > b is also infeasible. If the support 
system has a feasible solution x*, since we know x* is not a feasible solution to {(a£, x) > : % G S} 
(by Lemma [T3j) . we must have (c^, x) < < (aj, x) for some i £ S, which is a separating hyperplane 
between (A, b) and (^4',fo / )- 

From the above discussions, we know that every step can be implemented in polynomial time. 
Hence, by the ellipsoid method, we can solve the problem efficiently. □ 
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